Contested logistics simulation output analysis with approximate dynamic programming: a proposed methodology

نویسندگان

چکیده

Purpose Rapid sensitivity analysis and near-optimal decision-making in contested environments are valuable requirements when providing military logistics support. Port of debarkation denial motivates maneuver from strategic operational locations, further complicating Simulations enable rapid concept design, experiment testing that meet these complicated logistic support demands. However, simulation model analyses time consuming as output data complexity grows with input. This paper proposes a methodology leverages the benefits simulation-based insight computational speed approximate dynamic programming (ADP). Design/methodology/approach describes simulated environment demonstrates how informs parameters required for ADP dialect reinforcement learning (aka Q-learning). Q-learning includes policy prescribes decisions each state modeled simulation. paper's methods conform to DoD modeling practices complemented AI-enabled decision-making. Findings study means state–space reduction mitigate curse dimensionality. Furthermore, massive amounts become unwieldy. work reflect inputs so behavior can compare policies. Originality/value Fast computation is attractive while divorcing evaluation scenario-based limitations. The United States eager embrace emerging AI analytic techniques inform but hesitant abandon modeling. an aid overcome cognitive limitations way satisfies desire wield combined

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Approximate Dynamic Programming in Transportation and Logistics: A Unified Framework

Deterministic optimization has enjoyed a rich place in transportation and logistics, where it represents a mature field with established modeling and algorithmic strategies. By contrast, sequential stochastic optimization models (dynamic programs) have been plagued by the lack of a common modeling framework, and by algorithmic strategies that just do not seem to scale to real-world problems in ...

متن کامل

Proposed Approximate Dynamic Programming for Pathfinding under Visible Uncertainty

Continuing our preleminary work [2], we define the safest-with-sight pathfinding problems and explore its solution using techniques borrowed from measure-theoretic probability theory. We find a simple recursive definition for the probability that an ideal pathfinder will select an edge in a given scenario of an uncertain network where edges have probabilities of failure and vertices provide “vi...

متن کامل

Approximate dynamic programming with a fuzzy parameterization

Dynamic programming (DP) is a powerful paradigm for general, nonlinear optimal control. Computing exact DP solutions is in general only possible when the process states and the control actions take values in a small discrete set. In practice, it is necessary to approximate the solutions. Therefore, we propose an algorithm for approximate DP that relies on a fuzzy partition of the state space, a...

متن کامل

Approximate dynamic programming with affine ADDs

context-specific additive multiplicative ! " # # ! # ! " # $ # #% "& #% "&

متن کامل

Approximate Dynamic Programming via Linear Programming

The curse of dimensionality gives rise to prohibitive computational requirements that render infeasible the exact solution of largescale stochastic control problems. We study an efficient method based on linear programming for approximating solutions to such problems. The approach "fits" a linear combination of preselected basis functions to the dynamic programming costtogo function. We develop...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of defense analytics and logistics

سال: 2022

ISSN: ['2399-6439', '2399-6447']

DOI: https://doi.org/10.1108/jdal-07-2022-0004